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C ■ Abstract 
i— »; 

^vO 'Let (Xi)i>\ be an i.i.d. sample on R d having density /. Given a real function on M rf with finite 

CN ■ 

variation and given an integer valued sequence (j n ), let f n denote the estimator of / by wavelet 

f-H ! projection based on 4> an d with multiresolution level equal to j n . We provide exact rates of almost 

.sure convergence to of the quantity sup x . g ^ | f n {x) — E(f n )(x) |, when n2 _d - Jn /logn — > oo and H 

'is a given hypercube of R . We then show that, if n2 J "/logn — > c for a constant c > 0, then the 
?3 ■ 

£h quantity sup^g^ | f n (x) — f | almost surely fails to converge to 0. 
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1 Introduction and statement of the results 



^■The well known wavelet theory (see, e.g., Mallat (1989)) has proven useful in 
^ may branches of applied mathematics and functional estimation in the field of 
c3 istatitics. In this paper, we are interested in estimating the Lebesgue density / of 
an independent, identically distributed (i.i.d.) sample (Xi)i>i on R d . Let be a 
(mother wavelet) real function on M. d . There exists N = 2 d — 1 associated (father 
wavelet functions) ^j, 1 < j < N, so as any function / G L 2 (R d , A) has the 
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following orthogonal representation (for more details, see, e.g., Masry (1997)). 

N 

/:= E a jo,k4>j ,k + I! E I! Pi,j,k^i,j,k, where (1.1) 
fceZ d j>jo i=l fceZ rf 

:=2^( 2 i • tf.^ : = 2 d ^(2^ • — i < N, j > 1, k £ Z d . (1.2) 

i.i T/ie linear wavelet projection estimator 

The linear wavelet projection estimator (see, e.g., Masry (1997)) of / is con- 
structed by estimating the coefficients &j 0) k, fii,j,k by their empirical analogues: 

«jo,* : = - E <f>j ,k( X i)> Pij* : = - E , (1-3) 

n j =1 n i = i 

and stopping the expansion (11.11 ) at a deterministic (multiresolution) level j n , 
which will be assumed to grow with the sample size n. 

fn{x) := E &j (f>j ,k + E E E Pij,k%j,k- (1-4) 

The aim of this paper is to describe the almost sure asymptotic behaviour of the 
quantity | f n ix) — fix) |, uniformly in x £ H, where H is a given an hypercube of 
M. d . Obviously, the asymptotic behaviour of (j n )n>i plays a crucial role, and 2 _rfjn 
can be intuitively compared to the bandwidth when estimating / by usual kernel 
methods. Massiani (2003) has given an asymptotic result of f n when the sample 
(Xi)i>i takes values in M and under the following conditions, with h n := 2~ d ^ n : 

h n 4- 0, nh n t oo, logn — > oo, \og(l/h n )/ log log n — >■ oo, (1.5) 

/ is continuous and strictly positive on an open subset O and H C O, (1.6) 
has finite variation on M. d and has a compact support. 0--7) 
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Conditions ( 11.51) are called the Csorgo-Revesz-Stute conditions. Massiani proved 
that, under ( 11.51 ). ( 11.61 ) and ( 11.71 ) we have, almost surely, 



lim sup± — -— — — F -) (Ux) -E(fJx))) = 1. (1.8) 



We also refer to Masry(1997) for related results when (JQ)f>i is a stationary 
strongly mixing sequence. To prove ( 11.81) . the author made use of the following 
expression of f n (see, e.g, Masry (1997)) 



1 n 

Ux) :=- £ K jn (x,Xi), where (1.9) 

n i=l 

K(x, y) := E <K* ~ k)^(y -k),x,y€ M d , (1.10) 

kez d 

K jn (x, y) :=2 d ^K(2^x, 2>»y). (1.11) 



Then, the author showed that ( 11.91 ) can be expressed quite simply with the func- 
tional increments of the empirical distribution function, and made extensively use 
of related results established by Deheuvels and Mason (1992). We point out the 
fact that the just mentioned pioneering results do not cover the case where the 
sample is multivariate {d > 1), as this result relies on the strong approximation 
theorem of Komlos et al. (1977). As a consequence, Massiani could only prove 
( 11.81 ) when d = 1. However, Mason (2004) recently made a skillful use of some 
recent tools in empirical processes theory to extend the results of Deheuvels and 
Mason (1992) to a more general framework, which covers the case where d > 1. 
As a consequence, we are now able to prove the following result. 
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Theorem 1 Under assertions i\1.5\) . ill. 6}) . U. 7j) we have almost surely: 
(i) For each e > 0, there exists n(e) such that, for each n > n(e) and x G iif, 

l2 dj n . V2 



/nW-E (f n (x))) G [-l-e,l + e]. 



>2f(x) log(2*'« y 

(m) For each -u G [—1, 1] and e > 0, there exists n(e, i>) such that, for each n > n(e, v), 

i2 djn \ 1/2 / * 

' 7 n (x) - E(/ n W) 



inf 



2f(x) log(2^) 



v 



< e. 



As mentioned above, the uniform behaviour of the increments of the empirical 
process shows up to rule that of f n (x). Moreover, it is well known (see Deheuvels 
and Mason (1992)) that this behaviour changes abruptly when conditions ( 11.51) 
are replaced by the following Erdos-Renyi conditions: 



h n 4- 0, nh n t oo, nh n / logn — > c. 



(1.12) 



Here, c > is a finite constant. Since the pioneering result of Deheuvels and Ma- 
son (1992), several extensions have been made. In Varron (2007), Varron recently 
showed that this nonstandard UFLL still holds when d > 1. Our next result 
shows that, under ( 11.121) , the nonstandard behaviour of the empirical increments 
implies that the uniform strong consistency of f n on a hypercube H fails to hold. 



Theorem 2 Under ill. 6}) . U. 7j) . U.W) . the following event has probability 1: 



3 e > 0, Vno, 3n > no, 3 x n G H fulfilling 



1 



> e. 



1.13) 



2 Proofs of Theorem [T] 



Recall that h n := 2~ djn , n > 1. To prove Theorem [1], we shall require some 
more notations. Given s := (si, . . . , Sd) and v := (vi, . . . , Vd), we shall write 
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s -< v whenever Sj < V{ for each 1 < i < d and we shall write [s, v] for the set 
{u G M. d , s -< u -< v}. The increments of the empirical process based on (Xi)i>i 
are defined as follows (C denoting a Borel subset of 



^,^,,£7) :=»'/>(! fl (^)-E(l c (^))). (2.1) 

A standard argument of homothety shows that we can make the following as- 
sumption with no loss of generality: 

4> has finite variation on M. d and has a support included in [—1/4, 1/4] d . (2.2) 

Set I d := [— 1/2, l/2] rf , and consider the space B(I d ) of real, bounded, Borel 
functions on I d . We endow B(I d ) with the usual supremum norm, namely | 
g ||:= sup{| g(s) |, s G I d }. The proof of Theorem Q] strongly relies on the 
following fact, which is due to Mason (2004). Call H n the set of points x G H 
such that 2^ n x G Z d , and define the following Strassen-type set: 

Sja :={# g 5(/ rf ), 3# Borel, | g 2 d\ < 1, Vs G 7 rf , p(s) = J gd\j. 

I d [8,1/2] 

Fact 1 (Mason, 2004): Set 

/2/(.T)ft„log(l/ft„) ' - j 



Under assumption ( 11.51) and ( 11.61) . we have almost surely: 



(a) Ve > 0, 3n(e), Vn > n(e) and x G iif, inf || g na , — g ||< e 

(6) V# G S Id and e > 0, 3n(e,#), Vn > n(e,g), inf || § ¥ - g \ \< e. 

This fact is a nearly direct consequence of Theorem 1 of Mason (2004), considering 
the class T := {l[ S) i/2], s G by Remark F.2 in Mason (2004). 
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Remark 1 We point out the fact that Theorem 1 in Mason (2004) cannot lead 
to Fact 1 directly, because (b) involves the quantity inf{|| g nx — g ||, x 
instead of mi{\\ g U:X — g ||, x G H}. However, looking closely at the proof of 
point (b) of Theorem 1 in Mason (2004), we can see that H can be replaced by 
H n , as we can choose {zi,n, ■ • • , z m ni n} '■= H n in his proof of Lemma 2. 



Set, for fixed x G R d and n > 1 (recall ( QUI) ) 



K U:X {s) :=K{2 3n x, 2 Jn x + s), n G R d , seR d (2.4) 
r 2 : = 

n,x 



< x ■= / KUs)ds (2.5) 



By assumption ( 12.21) . each K UjX has support included in I d . Now, we consider 



the following continuous linear applications, from (B(I d ), || • || ) to R. For fixed 
x G M. d and n > 1, set 

Q n , x (g) := o n ^ x J g(s)dK n , x (s), g G B(I d ). (2.6) 

With these notations, we obviously have for each n > 1 and x G almost 
surely, 

( 2/(.x)S'(1/m ) 1/2 ( / " (3:) - E(/ " (I)) ) = 6 - ( * J ' (2J) 

so as the random objects involved in Theorem Q] show up to be correctly chosen 
functions of the increments of the empirical process. 

We first focus on proving point (i) of Theorem [U Standard analysis shows that 
®n, x {Si*) = [-1, 1] for each iGR* 1 and n > 1. (2.8) 
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Moreover, by definition of the K n ^ x and by (|2.2j) we have, T denoting the total 
variation of a function, 

sup r(K n , x ) < oo, (2.9) 

n>l, x&H 

inf <j nx > 0, whence (2-10) 

n>l, x&H ' 

SUp SUp | @ n ,x(9) \< °°- 

n>l, xEH geB(I d ), \\g\\=l 

Note that ( 12.101 ) is a consequence of the Cauchy-Schwartz inequality, as / K UiX (s)ds 
1 (see, e.g., Meyer (1990), p. 33). Now, combining ( 12.111 ) and point (a) of Fact 
1, we conclude that point (a) of Theorem Q] is true, by routine topology. 
We shall now prove point (b) of Theorem CD Recall that x G H n if an only if 
2 Jn x G Z d . Hence, by definitions ( 11.101 ) and ( 12.41 ) we have 

K n ^ x = K 0fi , @ njX = o ,o, n > 1, x e H n . (2.12) 

Now fix e > and v G [—1,1]. Recalling ( |2.8| ) we choose g G Sjd fulfilling 
®o,o{g) = v - Now, as Go ; o is Lipschitz, and by point (6) of Fact 1, we conclude 
that, almost surely, there exists n(e, g) such that, for each n > n(e, g), there exists 
x n G H n fulfilling | @ n ,x(g n ,x) ~ v |=| @o,o(g n ,x) - ©o,o(p) |< e. The end of the 
proof follows readily, as [—1, 1] is compact. □ 



3 Proof of Theorem H 



In this section, condition ( 11.51 ) is replaced by condition ( 11.121 ). We first define 



I n *x — x\ 

AF n (x, h n , C) :=——— ^ lcl-W- )» C Bore1 ' x ^ n > 1, (3.1) 
cj{x)nti n i=i \ ^ / 

fc^OO :=AF n (i, /i n , [s, 1/2]), sel d , xeH, n>l. (3.2) 
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Set h(x) = (xlogx — x + 1)1/q >0O \(x) + 1iq\(x) for x > and h(x) = oo otherwise. 
Now consider the following limit sets depending on a real parameter v > : 

I> :={#, 3^ Borel, / /i(p)dA < 1/v, Vs G 7 d , <?(*) = / <^A}. (3.3) 

7 d [s,l/2] 

We shall make use of the following result, which is a consequence of Theorem 1 
of Varron (2007). Recall that x G H n if and only if 2 Jn x G Z d . 
Fact 2 (Varron) Under assumptions (11.61) and (11.121 ). the following assertions 
hold with probability one. 

(a) Ve > 0, 3n(e), Vn > n(e) and x G iif, inf j| g n;X — p ||< e; 

(6) V x G H , ^ G r c/(a; ), e > 0, 3n(e,c/), Vn > n(e,g), inf || n>a . - g \\< e. 

Xkz±i n 



Remark 2 Note that Fact 2 differs from Theorem 1 in Varron (2007) by two 
aspects. First, the involved class of set is T\ := {lr S) i/2], s G I d } instead of 
T<i := {l[o,s]j s £ [0,1] }• However, by a standard translation argument, one 
can trivially transpose Theorem 1 in Varron (2007) from T<i to T\. Second, the 
cube H is replaced by H n in point (b). As in Remark 1, we underline that this 
replacement can be made by a close look at the arguments of Varron (2007) 

To prove Theorem M, we shall make use of point (b) of Fact 2. Similarly to what 
was done in §21 we introduce the following linear applications 

®' n ,M ■= 1 9(s)dK n , x (s), g G B(I d ). (3.4) 



Notice that, for any n > 1 and x G H n we have Q' nx = Oq since K n ^ x = Kq 

fn\% j 



'n,x ~ ^0,0 Hmcy ^n,x - ^0,0- 

Now, as 



: = &n,x(9n,x) = ®0fi(gn,x), Tl > 1, X G H n , (3.5) 
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the proof of point (6) of Theorem E] would be a direct consequence of point (6) of 
Fact 2, provided that the following statement is true for some 5 > : 

fl e' 0>Q (T cm>Id ) D {1-5,1 + 6}. (3-6) 

xeH 

Now, by definition of T v jd : v > we obviously have 

fl ©o,o( r c/(x),/ rf ) = €»o,o( r c/(x ),/ d ) = : ^ 

where f(xo) = sup{/(x), x G H}. Note that, when d = 1, the set J can be 
described by making use of the optimisation techniques of Deheuvels and Mason 
(see Deheuvels and Mason (1991), Theorem 3 and 4 and Deheuvels and Mason 
(1992), Theorem 4.2). To conclude the proof of Theorem [2], we shall now show 
that J has a nonempty interior. Define the following function for I d to M: 

d i 

go : (s h ...,s d ) ->> I](o ( 3 - 7 ) 

Obviously, go belongs to r^a. \ /<*, as go = 1 fulfills the requirements stated in 
( 13.31) . Moreover, an integration by parts leads to the conclusion that 

^ofeo) = / K n>x {s)ds = J K{s)ds = 1. (3.8) 

R d R d 

As T c f( XQ ^jd is convex and Tq is linear, the set J is an interval that contains 
Tq (#o) = 1- Moreover, as h is continuous at x = 1, we have pgo G T c f(x ),i d an( A 
/o _1 ^o £ ^ c f(x ),i d for p > 1 small enough, which entails, by linearity of Oqq, 

inf e ,o(g) < p- 1 < K p < sup e 0|0 (p)n (3.9) 
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